Establishing Applicability of SSDs to LHC Tier-2 Hardware Configuration
نویسندگان
چکیده
Solid State Disk technologies are increasingly replacing high-speed hard disks as the storage technology in high-random-I/O environments. There are several potentially I/O bound services within the typical LHC Tier-2 in the back-end, with the trend towards many-core architectures continuing, worker nodes running many single-threaded jobs and storage nodes delivering many simultaneous files can both exhibit I/O limited efficiency. We estimate the effectiveness of affordable SSDs in the context of worker nodes, on a large Tier-2 production setup using both low level tools and real LHC I/O intensive data analysis jobs comparing and contrasting with high performance spinning disk based solutions. We consider the applicability of each solution in the context of its price/performance metrics, with an eye on the pragmatic issues facing Tier-2 provision and upgrades International Conference on Computing in High Energy and Nuclear Physics (CHEP) 2010 Taipei, Taiwan
منابع مشابه
ScotGrid: Providing an Effective Distributed Tier-2 in the LHC Era
ScotGrid is a distributed Tier-2 centre in the UK with sites in Durham, Edinburgh and Glasgow. ScotGrid has undergone a huge expansion in hardware in anticipation of the LHC and now provides more than 4MSI2K and 500TB to the LHC VOs. Scaling up to this level of provision has brought many challenges to the Tier-2 and we show in this paper how we have adopted new methods of organising the centres...
متن کاملCost Effective Storage using Extent Based Dynamic Tiering
Multi-tier systems that combine SSDs with SAS/FC and/or SATA disks mitigate the capital cost burden of SSDs, while benefiting from their superior I/O performance per unit cost and low power. Though commercial SSD-based multi-tier solutions are available, configuring such a system with the optimal number of devices per tier to achieve performance goals at minimum cost remains a challenge. Furthe...
متن کاملVirtual Environments for Prototyping Tier-3 Clusters
The deployed hierarchy of Tier-1 and Tier-2 data centers, as organized within the context of the Worldwide LHC Computing Grid (WLCG), have without question been exceedingly successful in meeting the large-scale, group-level production and grid-level data analysis requirements of the experiments in the first full year of LHC operations. However, the plethora of derived datasets and formats thus ...
متن کاملEvaluating the impact of SSDs and InfiniBand in Hadoop cluster performance and costs
T his report evaluates the impact in terms of performance and costs of introducing Solid State Drives (SSDs) and InfiniBand networking technologies, over a typical commodity Hadoop cluster setup for Big Data processing. For the evaluations, over 1,000 benchmark runs are executed to the same Hadoop cluster, but varying the software (SW) configuration to find the best performance of a particular ...
متن کاملUnified storage systems for distributed Tier-2 centres
The start of data taking at the Large Hadron Collider will herald a new era in data volumes and distributed processing in particle physics. Data volumes of hundreds of Terabytes will be shipped to Tier-2 centres for analysis by the LHC experiments using the Worldwide LHC Computing Grid (WLCG). In many countries Tier-2 centres are distributed between a number of institutes, e.g., the geographica...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1102.3114 شماره
صفحات -
تاریخ انتشار 2010